Equivalent kernels of smoothing splines in nonparametric regression for clustered/longitudinal data
نویسندگان
چکیده
S For independent data, it is well known that kernel methods and spline methods are essentially asymptotically equivalent (Silverman, 1984). However, recent work of Welsh et al. (2002) shows that the same is not true for clustered/longitudinal data. Splines and conventional kernels are different in localness and ability to account for the within-cluster correlation. We show that a smoothing spline estimator is asymptotically equivalent to a recently proposed seemingly unrelated kernel estimator of Wang (2003) for any working covariance matrix. We show that both estimators can be obtained iteratively by applying conventional kernel or spline smoothing to pseudo-observations. This result allows us to study the asymptotic properties of the smoothing spline estimator by deriving its asymptotic bias and variance. We show that smoothing splines are consistent for an arbitrary working covariance and have the smallest variance when assuming the true covariance. We further show that both the seemingly unrelated kernel estimator and the smoothing spline estimator are nonlocal unless working independence is assumed but have asymptotically negligible bias. Their finite sample performance is compared through simulations. Our results justify the use of efficient, non-local estimators such as smoothing splines for clustered/longitudinal data.
منابع مشابه
Splines with non positive kernels
Non parametric regression methods can be presented in two main clusters. The one of smoothing splines methods requiring positive kernels and the other one known as Nonparametric Kernel Regression allowing the use of non positive kernels such as the Epanechnikov kernel. We propose a generalization of the smoothing spline method to include kernels which are still symmetric but not positive semi d...
متن کاملNonparametric Regression Analysis of Longitudinal Data
Nonparametric approaches have recently emerged as a flexible way to model longitudinal data. This entry reviews some of the common nonparametric approaches to incorporate time and other covariate effects for longitudinally observed response data. Smoothing procedures are invoked to estimate the associated nonparametric functions, but the choice of smoothers can vary and is often subjective. Bot...
متن کاملVariance Reduction in Smoothing Splines
We develop a variance reduction method for smoothing splines. We do this by showing that the quadratic interpolation method introduced in Cheng et al. (2006), for local linear estimators, also works for smoothing splines. For a given point of estimation, Cheng et al. (2006) define a variance-reduced local linear estimate as a linear combination of classical estimates at three nearby points. We ...
متن کاملUsing SIMEX for Smoothing-Parameter Choice in Errors-in-Variables Problems
SIMEX methods are attractive for solving curve estimation problems in errors-in-variables regression, using parametric or semiparametric techniques. However, nonparametric approaches are generally of quite a different type, being based on, for example, kernels, local-linear modeling, ridging, orthogonal series, or splines. All of these techniques involve the challenging (and not well studied) i...
متن کاملUniform error bounds for smoothing splines
Almost sure bounds are established on the uniform error of smoothing spline estimators in nonparametric regression with random designs. Some results of Einmahl and Mason (2005) are used to derive uniform error bounds for the approximation of the spline smoother by an “equivalent” reproducing kernel regression estimator, as well as for proving uniform error bounds on the reproducing kernel regre...
متن کامل